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ABSTRACT 


This investigation is concerned with the effects of 
employing a Kalman filter to estimate the states ina 
system for which the mathematical model is inaccurate. 
Consideration is given to both intentional and unintent- 
10nal mis-identification of parameters in the assumed 
plant dynamics. An algorithm consisting of four matrix 
equations is derived which yields the actual covariance 
of estimation error when errors in the assumed model are 
known. Depending upon the gain sequence used, the de=- 
rived eguations can be used to either 1) produce optimal 
estimates when errors are deliberate or 2) aid in the 
determination of mis-identification costs in terms of 
filter performance degradation if the relative accuracy 
of parameter identification is known. 

Analytic examples of scalar cases are included, as 


well as computer simulations for specific higher order 


systems, including the employment of a second order filter 


model with a fourth order plant. 
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CHAPTER 1 
INTRODUCTION 

In recent years, a considerable portion of the litera- 
ture in the field of automatic control has been concerned 
with plant identification and state estimation. In most con- 
trol problems, it is first necessary to establish a suitable 
mathematical model of the process to be controlled in order 
to perform any meaningful analysis or synthesis. Then, if 
some sort of observation of the process is available, this 
observation along with the mathematical model, and at least 
a probabilistic description of the forcing function, pro- 
vides the necessary information to implement an estimation 
scheme which will give a measure of what the plant is doing 
at the present time, has done in the past, or will do in 
the future. 

Whenever estimation is attempted with an inaccurate 
mathematical model, the estimation accuracy must of neces- 
Sity deteriorate. The investigation reported here is con- 
cerned with the degradation of estimation accuracy when an 
erroneous model of the plant dynamics is employed. 

At this point it is necessary to explain two reasons 
for not using an accurate mathematical model in the esti- 
mation scheme. The first is unintentional, a result of 
the simple fact that the mathematical model which most 
accurately describes the plant is not known. A second pos- 
sible reason might be the deliberate employment of a low- 
order model of a more complicated plant. Because the 


mathematical involvement of most estimation schemes is 


inescapably tied to system order, much computational time 
can be saved whenever the model order can be reduced. Such 
reduction may be necessary for "real time" estimation, at 
the expense of estimation accuracy. This is assuming of 
course that in the problem at hand, estimates of the higher 
order states are not needed. 

The three "tenses" of estimation mentioned above are 
known as filtering, smoothing, and prediction, respectively. 
In current practice "what the plant is doing" is described. 
mathematically by a state vector, the components of which 
represent the minimum number of entities required to com- 
pletely describe the condition of the plant. As an example, 
if the plant were a passive electrical network, the re- 
quired state vector components could be inductor currents 
and capacitor voltages. 

This investigation was restricted to a discrete- 
sampled-data description of the plant and estimation scheme. 
The use of this mathematical framework leads to a sequen- 
tial filtering scheme. In this technique of estimation, as 
in most, a weighting is given to each observation according 
to how much new information it gives relative to that 
already received. In current practice this weighting or 
"filter gain" is calculated to minimize (or maximize) some 
performance index which has previously been defined. When 
linear operations on the data are employed and the index to 
be minimized is mean squared estimation error, the resulting 


estimation scheme is called a Kalman Filter. [l, 5]. 
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The remainder of this Chapter includes the development 
of the plant model, a brief review of Kalman filter equations 
and a statement of the problem to be investigated. In Chap- 
ter 2, the results of some other recent investigations are 
discussed. In Chapter 3, a set of recursive equations for 
finding a measure of estimation degradation is derived, 
followed by three simple examples. Results of digital com- 
puter simulations using the derived equations for several 
examples are presented in Chapter 4. Chapter 5 consists of 
comments on the results of the computer simulations. 

THE PLANT MODEL 

Mathematical formulation of the problem proceeds from 
the assumption that there exists a set of linear, constant 
coefficient, first order differential equations which 
adequately describe the plant, or message generating pro- 
cess. These are of the form 

x = Ax + Bu fein 
Picte oe cmencmoLdtomVvectOr Or en  COMpOnents for an men order 
system, UW is the mx 1 input vector, and Ais n x n,; Bis 
nx m, both matrices of constants. The sampled data matrix 
difference equation which gives response at sampling in- 
stants becomes 

x(k+1) = 6(T)x(k) + TP (T)u(k) (1-2) 
where $(T) is the n x n discrete state transition matrix, 
r(T) 1s the n X m input distribution matrix and u(k) is a 
sampled and zero order held input vector. Constant differ- 
ential equation coefficients are not necessary, but are used 


here for Simplicity. The magnitude of each component of u(k) 


Jigli 


1s assumed to be a normally distributed random variable 

with zero mean and known variance [5]. The observations of 

the system states are assumed to be contaminated by additive 

gaussian white noise of zero mean and known variance. In 

matrix notation the observation vector Z at the Ken samo 

ling instant is given as 

z(k) = Hx(k) + v(k) (1-3) 

where H is the p x n observation matrix, here assumed known 

and constant and v(k) is the p x 1 vector of additiyver meas. 

urement noise. A block diagram depicting the above con-— 

ditions is shown in Figure 1-l. The double lines represent 

vector signal flow. 

THE KALMAN FILTER 

The sequential estimation technique developed by 

R.E. Kalman and expanded by others, takes the plant descrip- 

tion as defined in the preceding section, and produces an 

estimate xX(kK/K) Of the Stace vecreommn ee) at the misc 

iteration given k observations. This estimation scheme is 

commonly called the Kalman filter and can be described 

mathematically as 

R(K/k) = O(TYR{K=1/k-1) + GhkPiztky — Ho(T)x(ko17 ae 

(i—4)} 

where G(k) is the filter weighting or gain applied at 


fier 


iteration. This gain is calculated to minimize the 
scalar performance index 


J = E{[x(k)-&(k/k) 1” [x (k) -8(k/k) 1} (13) 


i1.e., the mean square estimation error. 


a 





ime. 1=T ine rlanv™siodel 


¥(k/ix) 





¥ (1-1 /ic-1 ) 


Fis. 1-2 talman Filter Jperations 
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The calculation of G(k) is facilataledeby Getanangea 
matrix of covariances of estimation error as 

P(k/k) = E{[x(k)-2(k/k) ] [x (k) -2(k/k) 17} (1-6) 
The trace of P(k/k) is of course simply J.” Witieche fume 
definition, 


P(k+1/k) = E{ [x (k+l) -2(k+1/k) ] (x (k+1) -@ (k+1/k) 17} 


(1-7) 
the Kalman sequential equations can be stated as; 
P(k+1/k) = 6(T)P(k/k)® (T) + Q(k) ae 
G(k+1) = P(k+1/k)H? [HP (k+1/k)H¢+R] > (1-9) 
P(k+l/k+1l) = [I-G(k+l1) BH] P(k+1/k) 
- P(k+1/k) H'G! (k+1) 
+ G(k+1) (HP (k+1/K)H-+R(k) 1G? (k+1) emp 
Equation 1-10 can be reduced to 
P(k+1/k+1) = [I-G(k+1)H]P (k+1/k) ( 1—1ees) 
where 
R(k) = E{v(k)v" (k)} 
Q(k) = P(T)E{u(k)u’ (k) }T* (t) 
E{*} = the expectation operation 
( 2 = the transpose operation 
( ) ae the matrix inversion operation 
li = the identity matrix 


R(k) is a p X p diagonal matrix based upon a priori know- 
ledge of the average measurement noise power. Q(k) is an 

n xX n matrix containing similar a priori information on the 
random excitation. Note that for the single input case, 
E{u(k)u" (k) } is a scalar which has been given the symbol 2 


in the development to follow. Under assumptions of 
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Stationarity of input excitation and measurement noise 
statistics, 2 is a constant and R is a constant matrix. 
For a scalar observation Ris also a scalar. It is further 
assumed that excitation and measurement noise are statis- 
tically independent. A block diagram of filter operations 
is shown in Figure 1-2. 

The derivation which leads from the definitions of 
P(k/k) and P(k+1/k), i.e. equations 1-6 and 1-7, to the 
recursive equations 1-8, 1-9, and 1-1ll, has been done in 
many ways by many authors since 1960 and will not be re- 
peated here [4, 7]. However, it will be shown that the 
recursive equations to be derived in Chapter 3 which 
account for filter degradation, reduce to the original 
Kalman equations when plant and filter models coincide, 
and the gain matrix is computed so as to minimize estima- 
tion errors. 

THE PROBLEM STATEMENT 

The problem under consideration can now be stated as; 
Given a plant most accurately described by equations 1-2 
and 1-3, what filter performance degradation results from 
the implementation of the Kalman filter equation 1-4, when 
the gain sequence calculated using equations 1-8, 1-9 and 
l-1l is based on a model of the plant which is incorrect 


in its representation of the plant dynamics? 


1) 


CHAPTER 2 
A REVIEW OF RECENT INVESTIGATIONS 

The practical difficulties encountered when attempting 
to identify a correct (or "best") mathematical model of a 
plant or process to be observed are not treated here. It is 
assumed that the identification has been done but is subject 
to errors or inaccuracies. The Kalman filter performance 
may be degraded by errors in any of the several quantities 
used in the calculation of the weighting G(k). (See 
equations 1-8, 1-9, 1-11). Numerous investigators have 
considered this problem; some of their results are summar- 
ized and commented upon below. Methods for practical 
implementation or error analysis have been included in some 
cases. 

In 1964 Fagin reported a generalized error analysis 
which included recursive equations for computing the incre- 
mental change in the covariance matrix when the filtering 
is done with an incorrect state transition matrix, and in- 
correct a priori noise statistics are used in computing 
gain [2]. The analysis allows a time varying observability 
matrix and sample interval. The assumed form of the plant 
in Fagin's investigation is enough different from the form 
assumed here that no attempt has been made to modify his re- 
sults to fit the framework of the problem given in Chapter 
1. A rough interpretation of those results using the 
notation of this paper, would be the effect of errors in 


®(T) ,Q(k) and R(k) matrices. 
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The recursive equations must be provided with starting 
values. The estimate &(0/0) must be provided as well as 
P(0/0) for the first gain calculation. Whenever possible, 
the values used for £(0/0) should be typical of what might 
be expected for the first observation. For instance if 
the output state of a system is thought to have zero mean, 
R, (0/0) should be set to zero. The initial covariance 
matrix P(0/0) must reflect some level of confidence in 
the initial filter state. Nishimura has defined an error 
matrix which is the difference between the actual covariance 
and that calculated by the filter [8]. He has shown that 
if the error matrix is non-negative definite, the actual co- 
variance of estimation Beeor is bounded by the covariance 
that is calculated using the Kalman recursive equations 
for the optimum filter, i.e., equations 1-8, 1-9, and 
1l-ll. This suggests that the trace of P(0/0) be given 
large values to ensure that the trace of the error matrix 
is non-negative. If application is restricted to system 
models which are fixed and uniformly completely observable 
and controllable, in the control theory sense, then accord- 
ing to Kalman, the calculated covariance matrix will con- 
verge to some constant matrix after enough samples [6]. 

The number of iterations required to reach steady state 

also depends on P(0/0). If this matrix is initialized 

with overly "pessimistic" values to satisfy Nishimura's 
stability condition, the filter may take too long to reach 
steady state in a given application. Therefore, when filter 


"settling time" is critical, the initialization of P(0/0) 


7 


requires some additional knowledge of the variance of the 
plant states so that stability may be ensured without 
unnecessarily increasing settling time. For this investi- 
gation the initial filter state (070) Is? Setecamume Came 
value as the plant initial vector and P(0/0) is set to the 
zero matrix. 

Normally stationary statistics are assumed for the 
input excitation and measurement noise, making 2 and R 
constant matrices. Errors in these quantities directly 
affect the elements of the steady state calculated ce- 
variance matrix. In 1966, Heffes reported on the effects 
of both incorrect initial covariance matrix and incorrect 
noise statistics in the model [3]. He includes recursive 
expressions for calculated covariance and gain matrices 
based on the false values. Results of a computer simula- 
tion of a numerical example showed the variance of the 
first two states of a third order system as calculated 
from the equations was always larger than that actually 
being attained, the latter of course being still greater 
than the optimum, given the correct model. In order to 
better isolate the effects of erroneous identification of 
plant dynamics, 2 and R will henceforth be assumed known 
and constant. 

During this investigation, the authors'became aware 
of very similar work being performed by S.R. Neal at NOTS 
China Lake. When they are published, comparison of 
mathematical results of the two investigations should re- 


veal only differences in notation and assumption on the 
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form of the plant model. Both consider plant dynamics as 
being misidentified in some way, resulting in errors in the 
assumed state transition matrix. By isolating this type of 
error, it may be possible to learn which of the types of 
error discussed in this chapter would have the most degrading 
effect on filter performance in a given application. Per- 
haps greater emphasis could then be placed on elimination 

of certain types of error when establishing the system 
mathematical model. 

The effects of any of the identification errors dis- 
cussed above can be found by producing a set of recursive 
expressions which will produce the matrix of actual error 
covariance P (k/k) and then comparing this with the 
covariance matrix P (k/k) produced by using the normal 
Kalman equations. Another very important comparison is 
that between P_ (k/k) and the optimum result P (K/k) 
obtained when the plant model is known exactly. The 
difference between these last two quantities gives the 
true "cost" of plant mis-identification in terms of 
variance of estimation error, and is the measure of degrad- 
ation used in this paper. These quantities are formally 
defined and a set of equations is developed for P (k/k) 


in Chapter 3. 


une) 


CHAPTER 3 
THE PROBLEM DEVELOPMENT 

As the first step toward a solution to the problem of 
filter performance degradation, a measure of degradation 
must be formally defined, along with the various covariances, 
according to the manner in which they were obtained. These 
definitions are as follows; 

The measure of filter performance degradation to be 
used is defined as the trace of the difference matrix AP 
where 

AP = P , (k/k) = P (k/k) (steady state) (3-1) 

P, (k/k) is an Xn matrix, the elements of which are 
the covariance values of actual estimation error produced 
by the filter when a given (and possibly suboptimal) gain 
sequence G(i), 1 = 0O,1,2,..... k is used in the filter 
equation 1-4, and there has been mis-identification of 
plant dynamics. The recursive equations to be developed 
in this chapter will produce P_(k/k) . 

Po (k/x) is an X n matrix of the covariance values of 
estimation error which results when the optimum gain 
sequence Gofl), peel 2s. . oe k, 1s used in the filter 
equation 1-4, and there has been no midmuldentifi Cacmennmen 
plant dynamics. Equation 1-1ll produces Po (k/k) provided 
there are no identification errors as discussed above. 

The third quantity to be defined is P (k/k) . has is 
a matrix of the covariance values of estimation error re- 
sulting when a given (and possibly suboptimal) gain se- 


quence’ Gli)"; = 0. , 2 eee k, is used in the filter 


equation 1-4, and there has been mis-identification of 
plant dynamics. P (k/k) 1S a Square matrix of the same 
dimensions as the order of the filter model. Equation 1-11 
produces P . (kK/k) provided there are identification errors 
as discussed above. The means of producing the three quan- 
tities defined above are diagrammed in Figure 3-l. 
THE OPTIMUM FILTER 

An estimation problem that can be fitted to the Kalman 
filter framework is solvable by use of equations 1-4, 1-8, 
1-9, and 1-11. This requires that the plant be perfectly 
described by equations 1-2 and 1-3. However, when the 
filter employs an incorrect model, the recursively calcu- 
lated covariance (equation 1-11) is no longer optimum, so 
the performance index as given by equation 1-5 no longer 
applies. The objective of minimizing the mean squared 
error is still valid but the mean square error now becomes 
the trace of the actual covariance matrix of estimation 
error, P_(k/k) . To distinguish the types of covariance 
mentioned thus far, subscripts have become necessary. In 
the derivation of PB (k/k) which follows, the subscript f 
denotes filter quantities while the subscript p refers to 
the most accurate mathematical model of the plant or system. 
THE SUBOPTIMUM FILTER 

Suppose the matrix difference equation giving the 
response of a discrete system at sampling instants has 
been identified as 


x(k+1l) = 0, (T)x(k) +P, (T)u(k) (3-2) 


2 


Plant 





Under 
Observation 
ee) 
P, (K/ic) 
OPTIMUS FILTSR 
Perfect erdenta lication whe 
uses equations X, (k/k) 
1-3, 1-9, 1-11 Zquation 1-4 [Tahaan 
variance 
estiiictes 
P (k/k) 
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LeaentsLLeaction. ercoms = 
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when the most accurate description of the same system is 


given by, 

x(k+1) = pre ee) 05) sa Sales) (3-3) 
where 

® -(T) +69 (T) = Ly Pr. (T) +0P (T) - eas (3-4) 


Assume the observation in either case is given by 

Z(k) = Hx(k) +v(k) (35 2)) 
If the Kalman filter equations 1-8 through 1-10 were to be 
used, the filtering would be suboptimal, i.e., equation 1-5 
would not be minimized. This is readily seen by noting 
that equation 1-8 becomes 


P(k+1/k) = 6, ()P(k/k) 07 (T) +0, (25) 


and being independent of observed data, cannot reflect 
errors in $(T). The calculated gain which depends upon 
equation 3-6 would therefore be suboptimum. 
THE ACTUAL COVARIANCE MATRIX 

The errors 60(T) and é6f(T) are taken into account as 
follows: 

Assume a plant has been misidentified as in the last 
section, equation 3-2, and a Kalman filter applied. The 
filter equation would be; 


R(K+1/k+1) = 0, (T)R(k/k) +G(K+1)[Z(k+1)-H 0, (T) 2(k/K)] 


(35d) 
If this equation and the correct plant description, equation 


3-3, are substituted into the appropriate quantities of the 
definition for P(k/k), equation 1-6, the resulting expres- 
sion becomes P_(kK/k). This can be shown as follows (reduc- 


ing the index by one and dropping T from $(T) and I(T) ), 


a 


x(k) -8(k/k) = © x (k-1) +P u(k-1) -0 8 (k-k/k-1) 


-G(k) [2 (k) -Ho,8(k/k) ] (3-8) 


but 09 = $0,+694 
p 16 


and for convenience define 


* 
® .-G(k) HO =, (3-9) 
§0-G(k)H60=60° (3-10) 


x 
Taam Gilgheg)s Fi ae aan) 
P P P 


then after some manipulation, equation 1-6 becomes, 


* 


P(k/k) = %,P_(k-1/k-1) ®, 


fa 
+0-E{x(k-1)x" (k-1) }60— 
-0/E{&(k-1/k-1)x" (k-1) }60" 


* * 
+60 E{x(k-1)x (k-1)}0," 
* T xT 
-6 E{x(k-1) 2 (k-1/k-1) }9, 
* 
+60 E{x(k-Ik’ (k-1)}60" 
* * 
+P Stu (kody (codeine 
yan es Pp 
Ab eel 
+G(k) Etv(k)v (k) ¥#G” (k) (Breil. 2) 
Now, taking the definition, equation 1-7, reducing the 


index by one and noting that 


R(k/k-1) = 0,8(k-1/k-1) (3-13) 


then upon substitution of appropriate quantities, equation 
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1-7 becomes 


P_(k/k-1) = ® -P_(k-1/k-1)%," 
+0 E{x(k-1)x- (k-1) }60° 
-$ E{&(k-1/k-1) x" (k-1) }60" 
+§0E{x(k-1)x° (k-1) }6," 
-§ 0E{x(k-1) &" (k-1/k-1) }®," 


+60E{x(k-1)x (k-1) }66" 


+1 E{u(k-1) uo (k-1) }P* (3-14) 


Comparison of equation 3-12 with equation 3-14 and 
Ene use of the definitions in equations 3-9, 3-10, and 3-ll, 
reveals that 


P_(k/k) = P_(k/k-1)-G(k)HP_(k/k-1)-P_(k/k-1)H°G" (k) 
a a a 
+G(k) (HP, (k/k- LH +RIG- (k) (3-15) 


Kalman has shown that if gain is calculated from equation 
1-9, the trace of the right hand side of equation 3-15 is 
minimized, and the recursive equation 1-1ll is obtained. It 
can be concluded here that given a known error 69%, the 
recursive equations which would be used for minimum variance 
estimates would be 1-9, 3-7, 1l-ll and 3-14. 

That is to say, if a Kalman filter is to be applied 
with a known error 6¢ in the model of plant dynamics, then 
minimum variance estimates can still be produced, provided 
the error 6¢ is taken into account by use of equations 1-9, 


3-7, 1-11 and 3-14. Except for the case of intentional 
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mis-modeling for the sake of order reduction, the error 69 
would of course be used to correct 2. and the original 
optimal Kalman filter equations 1-8, 1-9 and 1-11 would be 
used. 
THE RECURSIVE CALCULATION OF ACTUAL COVARIANCE 

Equation 3-15 is entirely suitable for use as a recur- 
Sive expression for computer simulation. However, equation 
3-14 must be adapted from its present form to one which 
avoids explicit use of the expectation operation. The 
approach taken was to define the matrix quantities 

D(k) = E{x(k)x’ (k) } (3-16) 

K(k) = E{(k/k)x" (k) } Pek) 
Matrix algebra and the advance of index yields (from equa-~ 
tion 3-14) 


Saas = oP (k/k) o, +0,D(k) 60-4 K(k) 667 


a 


+60°D" (k) 0 -69K" (k) Op) +60D(k) 60°49, ( 3808) 


Fguation 3-18 is in usable form, but requires recursive ex- 

pressions for D(k) and K(k). These are obtained from the 

definitions (equations 3-16 and 3-17): 

D(K+1); = B{x(k+1) x" (k+1) }=B{ (0x (k) 47 a (k) 1 (0x Ok) +1 ou (k) 17) 
(3-19) 

Expanding the right hand side and noting that u(k) and x(k) 


are uncorrelated, 


A E 


D (k+1) 


i iD 
b b 
pe ix(k) x (k) } +P Etu(k)u ( 


ay 
@ D(k) ® Se 0 
: (k) gene ( ) 


k) ITs 
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Similar manipulations with the definition of K(k+1l) yield 
K(k+1) = E{@(k+1/k+1)x! (k+1) } 


= [I-G (k+1) H] © ,K (k) &°+G(k+1) HD (k+1) Coo 


The iterative expressions derived are now summarized in the 
proper order for calculation: 


P(k+1/k) = ® P(k/k) 6, '+6,D(k) 6°-®,K(k) 60° 
+D(k) 9, -80K" (k) 0," +56D(k) 66" 


fi 3-18 
Q,, ( ) 


G(kpiye PUT evn. [HP (eeiesk eek | ee (1-9) 


PCC mee eee > Cerny ey G1) HP CK?) /k) oP Uke 7k) BOG Rd) 


+G(k+1) [HP (k+1/k) H'+R] G2 (k+1) Bais) 
ae 
D(k+1) = 6 D(k)6 7 
isin) oD (k) O40, (3-20) 
en ee [1-G (K+1) H] ®,K(k) 9° +G(k+1) HD (k+1) (3=21) 


Several comments on the appearance of equation 1-9 in this 
list are appropriate at this time. First, if the plant is 
correctly identified i.e., O. = ot 64 =s05 then it is 
Obvious that equation 3-18 reverts to 1-8 and equation 3-15 
is of course equation 1-10. Equations 3-20 and 3-21 would 
still exist but would not be used in 3-18, therefore stan- 
dard Kalman filtering results. Second, if the plant is 
mis-identified, the use of equation 1-9 in the order shown 
will produce the set of minimum variance estimates to be 
used in the case of order reduction mis-modeling, mentioned 


above. Third, if any other gain sequence is produced ex- 


ternally to equations 3-18, 3-15, 3-20 and 3-21 then 


2 


equation 3-15 will give the actual covariance of eStitiiation 
error that would result when the gain sequence suppiied is 
utilized in the Kalman filter equation 1-4. 
THE SENSITIVITY TO ERRORS IN PLANT DYNAMICS 

One of the original objectives of this investigation 
was to find an analytic expression for the sensitivity of 
the performance index J to plant identification errors. 


This would be of the form, 
qj =~ da, + — da, Te cease ¢ 


where Os is one of the plant parameters subject to mis- 
identification. The development of such an expression 
would involve finding total differentials for each of the 
trace elements of Be (steady state) and then adding to get 
dJ. If the filter is stable and Pi (k/k) eventually reaches 
a constant value, an implicit expression for the steady 
state covariance 1S easy to obtain by setting P (k+l /k+1) 
equal to Po (k/k) . The difficulty lies in the amount of 
algebra involved when the system order is two or greater. 
Each partial derivative of an element of the covariance 
matrix is a function of all the other elements. 

To then find partial derivatives of the steady state 
covariance matrix trace elements, P (k/k) is considered 
along with its definition, 


P(k/k) = E(x (k) x" (k) -&(k/k) x" (k) -x (k) 2 (k/k) +2 (k/k) 2” (k/k) } 


wt 


D(k) -K (k) -K? (k) +E {2 (k/k) 27 (k/k) } (3292) 
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The sum of the terms on the right hand side reaches a con- 

stant or steady state value. Moreover, it can be shown 

that in a stable system in which $(T) # I each of the terms 

in the sum becomes constant. For example, in the stable 

time invariant plant with feedback, the average "power" in 

the states D(k) becomes a constant times the driving "power". 
Therefore, D(k+1) is set equal to D(k); an implicit 


function is obtained and Dee where oan is a plant parameter, 


oon veo. 
samebe found. The paytial derivative cea will be the sum 
of the similar quantities on the right hand side of equation 
3-22. The procedure is straightforward, but the amount of 
algebra is prohibitive. No better method was found. 
EXAMPLES 

The examples which follow will serve to demonstrate 
how rapidly algebraic complication can arise with slight in- 
creases in plant complexity. All are scalar cases, making 
the performance index J equal to the steady state covariance 
P. For the two simplest examples a sensitivity function is 
calculated, as well as the actual filter degradation ex- 
pression. For the low pass filter example, a means of 
obtaining the sensitivity function is discussed, but it is 
not done. In that example only the degradation expression 
is included as a function of the plant parameter. 
Example 1: A Simple Amplifier 

Consider the plant shown in figure 3-2. The state x 
at the kth sampling instant is given as x (k) = au (k). 


By comparison with the usual state space discrete notation 


2g 


it can be seen that @(T) = 0; Y[T{T) =a 

The kth observation 1S written as Z(k) = x(k) +v(k) 
Suppose that optimal estimates & (k/k) of the state x are 
required. Then application of equation (1-4) yields 


R(k/k) = G(k)Z(k) (3-23) 


v (k) 
u (k) pa x (k) aye z (k) 


alien” G12 
The Simple Amplifier 


Applying equations (1-8), (1-4), and (1-11) for optimum 


filtering, the recursive sequence becomes 





2 
Filter gain: G(ktl) = 2"— (3228 
a (+R 
| Rag 
Error Covariance (variance): P(k/k) = 5 (3-25) 
a +R 


Conditional Error variance: P(k+1/k) = 623-01 3a2en 


Substitution of the expression for gain into equation 3-23 


yields 





Zio 
R(k/k) = 2 Z (k) (3897) 
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Recalling that 2 is the variance of the perturbation and R 
is the variance of the measurement noise, the quantity aa 
could be thought of as the average signal "power" and R as 
the average noise "power", making the optimal weighting 


Signal power 


SignalepOveE™amtiolse power 
which satisfies intuition for the case of observing a signal 
in noise. 
The sensitivity function for this example can be found 
easily by differentiating equation 3-25 with respect to the 
plant parameter. 


dP = 2R*Qa (3-28) 
da (a“Q+R) - 


Now suppose that the true plant is as shown in figure 
3-2, but that the amplification has been incorrectly identi- 


fied as ag where a=a, + Oda. Application of the Kalman 


f 
filter equations then gives a calculated gain 
a® 0 
G. Se oa (3-29) 
a eltR 


If this gain is used to estimate x, the degradation due to 
misidentification can be found as the difference between the 
covariance resulting from uSing equations 3-18 and 3-15 and 
the optimum value. Substitution of G. into equations 3-18 


and 3-15 yields 
Es R(a,Q+Ra°) 


P_(k/k) ; 


(3=30) 


(a, Q+R) 7 


Note than when ae= a this reduces to equation 3-25, as re- 


quired. The degradation in performance P is therefore 


Sul 


obtained by subtracting the right hand side of equatrion 3-25 
from P_(k/k) as given in equation 3-30. 


Degradation AP = P_ - P 


2 


R 0° (a*-a,* 


) 2 


i a (3-31) 
2 ee 
(Ago+R) (a Q+R) 


Figure 3-3 shows degradation in the performance index J as 
a per cent of the optimum versus percentage error in the 


plant parameter. The values used were 


Degradation in this example is very slight; an error of 30% 
in identification degrades the filter performance by only 
.00133%. This may be partially explained by noting that the 
degradation function shown is approximately directly propor- 
tional to the square of the measurement noise variance, 
and that a very low value was chosen for R. Nevertheless, 
it can be concluded that the Kalman filter performance is 
not very sensitive to plant identification in this applica- 
tien. 
Example 2. Integrator-Amplifier 

As another example of only slightly greater difficulty, 


consider the plant described by the transfer function 


A, 


me 
Wt 


: 


Ss) _a = 
= aes (3-32) 


Figure 3-4 shows the discrete representation of this plant. 
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Fig. 3-3 Degradation for the Simple Amplifier 
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The difference equation describing the response at sampling 
instants is 

x(k+1) = x(k) +aTu(k) (3-33) 
with the observation again consisting of a single state plus 
noise. Examination of equation 3-33 reveals that 

o(T) = 1 


0 = Van (3-34) 


Tie =a 


The. Kalman filteyyequatrvons  el—o, toed 1=1) become, 


respectively 
P(k+1/k) = P(k/k)+Q (3-35) 
| _ P(k+1/k) = 
JRE (ke _ 
P(k+1/k+1) = P(k+1/k) +R (3-37) 


The steady state covariance can be found by equating 
P (k+1/k+1) to P(k/k). As in the previous example, this 
1s optimum filtering when identification of the plant 
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parameter a is perfect. The resulting covariance is the 


solution to a quadratic equation, viz., 


1 Pe aay ey 
I Se yey painter tei) (3-38) 
Substitution for Q yields 


P. = = (V0 aT FERN T?-Na? Tt?) (3230) 


Sensitivity of the steady state optimum covariance to the 


plant parameter a becomes 


QP. aT? 


(@arT*+2R 
da 


——_ —_———_ - 1] (3-40) 
VQ° ase’ FORQa °T 

The sensitivity function was easily obtained in this example, 
and could be used to determine degradation for small pertur- 
bations in the parameter a. 

As in the previous example, it is now assumed that ae 
was used as the amplification value in the filter model, 
and the gain sequence resulting from the misidentification 
is known. The final value of the filter gain could be 


found by manipulation of equations 3-35, 3-36 and 3-37 to 


yield 





il 
Gr = 


2 
[VO, +4RQ--O6] (3-41) 


NO 


R 
This is the steady state value of the gain sequence used for 
the erroneous filter models and therefore can be used to find 
the actual value of steady state covariance. The actual 
steady state covariance is again found by proper substitu- 
tions in equations 3-18 and 3-15 to be 
(1-G9"O,+G_°R 


Paagt 


- (3-42) 


pn 2 
2G - Ge 
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Comparison of equations 3-41 and 3-38 reveais that it 
identification were perfect, the optimum steady state co- 
variance would be 


P= Gee (3-43) 
O 


The degradation due to identification error then becomes 
AP = P_-P 
ao 


(a: Ge) Q +G_ R(1+G_) 2G.G R 


AP = is (3-44) 


ye 
2G_ Ge 
From equation 3-34 


Q,, = Qa*tT? (3-45) 


If equation 3-45 is substituted for Q- in equation 3-41 the 
final value of the optimum gain sequence results 
1 


G. = sql Vora’ T "+ Pie > Ser aad x (3-46) 


Again using equation 3-34 to obtain Qe and substitution the 


result into equation 3-41 yields 


f Salvia, T'FaRa,T?-0a 277] (3-47) 


Substitution of equations 3-45, 3-46, and 3-47 into equation 
3-44 gives the degradation as a function of a and ae. It can 
be shown that equation 3-44 becomes zero as required, when 
G, = Ge. A 2b of equation 3-44 is shown in figure 3-5. 
The constants used were 

R= .O01; 2 = 120. ae = 200 
As in the previous example, degradation is not very great 


with considerable errors in identification, for the a priori 


nNOoLSe Statist ileswehocen . 
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x 100% 
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Pig. 3-5 Degradation for the Integrator-Amplifier 
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A final comment on this example is that althou.rn ite 
assumption that the individual terms on the right hand #:de 
of equation 3-22 become constant does not hold for this 
plant, the results obtained by using equations 3-15 and 3-18 
are still valid. This will be the case whenever $(T) is the 
identity matrix or unity as it is in this example. 

Example 3. Low Pass Filter 

The plant shown in Figure 3-6 represents a more meaning- 
ful example and is not too complicated for algebraic analysis. 
This 1s the discrete model for the continuous system trans- 


fer function. 








PIg, o=0 


Low Pass Filter 
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The difference equation describing the plant is 


x(kt1) = e 97x (k)+(1-e727) u(k) (3-48) 
therefore o(T) = e 27; T(t) = l-e 
The observation is again 

z(k) = x(k) + v(k) 
The plant parameter is again a. 
As in the previous example, it will be assumed that mis- 
identification has resulted in an erroneous filter model, 
H.e., 


-a_-T -a_T 


>. (T) =e ff; [, (T) = l-e 


It is further assumed that the gain calculation is based on 
the Kalman equations, resulting in the following steady 
state gain: F 

Pe PotQs 


Og Gay a (3-49) 
£ ?. PtQ,+R 


Now the effects of the erroneous identification can be found 
by using equations 3-18, 3-15, 3-20 and 3-21, along with the 
gain as given in equation 3-49. However the steady state 
value of P(k/k) is required which for this example is the 
solution of a quadratic scalar equation. From the Kalman 


equations it can be shown that 





a 1 at ces ae /(O.4+R-RO,? 2 2 5 
Po = ag te Q_-R+V(Q-+R-RO Dy +4RO, 0, } (3-50) 


Substitution of equation 3-50 into 3-49 yields an expression 


for G, in terms of plant variables only. 
2 = el aay (mp as ae Sm 
R® +O, R+ (9 -+R-RO, ) +4RQ. 9, 
GS os ae (3-51) 
2 iGmeR Ree 2 / mg 
RO, “+O -+R+V(Q_+R-RO_ y*+ RQ, 9, 
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It should be noted that a sensitivity functzon = could 
have been obtained by solving for P(k/k) in equation 3-49 
substituting for the steady state gain from equation 3-51, 


and then forming ae . a , 905 and le - However, the 


90, f da Ja 
expressions obtained are unwieldy and reveal little insight 
into the problem of filter degradation. The sensitivity 
function approach has the further limitation of small param- 
eter variations whereas the application of equations 3-18, 
3-15, 3-20, 3-21 does Mot. If the™gaihgas given by equaeien 
3—-51.is used far the filter, equations 3-18, 3-15) 35205 
3-21 give the conditional covariance of estimation error as 


the following 


a 2 2-2 = a | 
P (kt+1/k) = 2, Pa S/o -) D(k) Sep oo 


(3-52) 
Again, it is obvious that when plant model and filter model 
coincide, the result is the Kalman equation for conditional 
covariance. Proceeding to the expression for the steady 
state covariance of estimation error, one obtains 


_ | 2 
di 2G, +G, 


P = eee 
a Gp (2-Ge) 


[(8 5 Ds = 205 (O5- OE)K SHO Fi (3-53) 
Where Dd. and K, are the steady state values of E{x*} and 
E{x&} respectively. These are found by equating the values 
at the geayae iteration to those for the a iteration as 
follows: 


- 2 . ‘ ™ p = 
D(k+1) = 9,?D{k)+0,7 D. = y-§—7 (3-54) 
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GQ 
K(k+1) = (1-G_)_% K(k) +G,D(k+1); K, = ti). See 
omer ) Nc EEN, 
(3-55) 
Substituting equations 3-54 and 3-55 into 3-53 one obtains 
an expression for the actual steady state covariance in 


terms of the gain 


a 2 
— (1-Ge) (6 *~O2°) (1-Ge%e%,) -205 (8 --)G, 
Beg = Gey 1-G,o 6 +Q,, 


Det 
(3-56) 


Equation 3-56 shows that when = = O- the expression for 
optimum covariance would be 
> 2 
os eo (3-57) 
O O 
Where G.. is the steady state gain obtained by using Kalman 
equations with the correct model, as in equation 3-5l. 


Making substitutions for G, and Go the degradation in 


1 


filter performance can be found as 


i.e., equation 3-56 minus equation 3-57. 
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CHAPTER 4 

COMPUTER SIMULATIONS 

The great increase in complexity of sensitivity 
functions which accompanies the slightest increase in 
system complexity was readily evident in Chapter 3. 
Even a scalar case such as the low pass filter with a 
Single pole produces unwieldy algebraic expressions for 
sensitivity. For systems of second order or higher, it 
appears to be more advantageous to perform a computer 
Simulation of some specific case. This portion of the 
investigation was performed on the CDC 1604 Digital 
Computer and consisted of four parts. The first was a 
verification of the algorithm derived in Chapter 3 
(equations 3-18, 3-15, @-20 and 3-21). This algomi chm 
while ostensibly accurate, provides numerous opportunities 
for error in its implementation. The remaining simu- 
lations were investigations of specific examples to 
test the utility of the recursive solution in actual 
problems. The desired end result was a means of knowing 
the degradation of filter performance as a function of 
error in one or more plant parameters, given the filter 
Operating parameter values. Such information, along with 
the knowledge (or an estimate) of the accuracy of the 
filter model parameters, could be useful in deciding 
whether more (or less) accurate identification is called 


for. For example, assume the model for a second order 


system uses a damping factor Ce and a natural frequency 
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Wp which through some previous error analysis are known 
to be accurate within 10 per cent. A look at the steady 
state solution obtained from the recursive equations 
based on ten per cent errors will provide the actual 
degradation in filter performance if the plant parameters 
lie on the tolerance limit. 

For this example, suppose that this amount of 
degradation from optimum is incompatable with the 
estimation accuracy requirements. By examining the re- 
sults for various lower parameter errors it will become 
apparent to what accuracy the parameters must be iden- 
tified. A flow chart for this type of investigation is 
shown in Figure 4-l. Given a gain sequence, an estimate 
of parameter error, the filter model and the correct 2, 


‘R, and H matrices; the quantities Per Ca, Qe, and Q., 


p 
can be found and used to implement a recursive sequence 
of equations 3-18, 3-15, 3-20 and 3-21. In all examples 
which follow, the filter model employs correct initial- 
ization and accurate 2% and R matrices. All are single 
input systems with only one observed state making % and 
R scalars, with values taken as 1.0 and 0.01 respectively. 
a. VERIFICATION OF RECURSIVE SOLUTION 

Hqudemons S86, 3-15, 3-20 and 3-21 of Chapter 3 
were verified by comparing the actual steady state 
covariance matrix trace with that obtained by driving 
a simulated plant, observing the entire state vector 


ae 


and computing the quantity [(x - &) (x - ¥)°]. This was 
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Degradation due to Aa's 


Fig. 4-1 Calculation of Filter Performance Degradation 
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done for each filter-plant combination for 1000 different 
random sequences of driving and measurement noise, pre- 
serving the average values at each successive iteration. 
At least 30 iterations at steady state were used. The 
ensemble averages were then averaged in time, giving 
30 samples from which hypothesis testing could be done. 
The entire procedure above was repeated for numerous 
points including from zero to 20 per cent errors in each 
plant parameter in order to verify that no programming 
errors existed in the calculation of actual steady state 
covariance. 
b. EXAMPLE OF TWO-PARAMETER SENSITIVITY 

Next, a numerical example of two-parameter sen- 
Sitivity was performed using the method outlined in 
Figure 4-1. The second order model was chosen to be of 


WwW 


Z 
the form £ (4-1) 


2 : 2 
s“* + 2e,W,S + W ¢ 


with filter parameters Ce and w, taken as Cos(t/4) and 


ii 
10.0, respectively. The plant was assumed to be driven 
and sampled at 0.1 second intervals, with initial con- 
ditions zero, and with x; the only observable state. 

The plant parameters by and ws were varied from zero to 
mes Of Chose used by the filter model. For each set of 
plant parameters, the difference between the actual 
covariance trace and that which could be obtained if the 


filter matched the plant is computed and stored. The re- 


sulting values are points on a bowl-shaped surface which 
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Fig. 4-2 Degradation vs 


are then contoured by linear interpolation into the c-w 
plane. Figure 4-2 shows the resulting contour map. The 
contours are marked as a percentage degradation from the 
optimal trace as a function of the percentage error in 
the filter parameters. Such a graph could assist not 
only in the type of decision mentioned earlier, but also 
in a determination of which direction of error is more 
costly by considering the "gradient" of the surface in 
the various directions in the parameter plane. 
c. MODEL ORDER REDUCED BY ONE 

The case in which a third order system with a 
complex conjugate pair of poles and a remote real pole 
is to be filtered by a second order model was also 
considered as a numerical example. The erroneous filter 
model was based on the plant transfer function 


X(S) 2 (4-2) 
U(S) s* + 25 + 2 





While optimum filter used the model 


X(S) = 2a (4-3) 
U(S) (eye te i YD) Ges ay 





where a wasS allowed to vary from 50 to 0.5 in increments 
of 0.5. Both models are type 0 with the same complex 
poles, since this is considered to be a case of deliberate 
misidentification. 

The recursive matrix equations were made compatible 
by the addition of a row and column of zeros in the state 


transition matrix for the filter and used as before. 
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Fig. 4-3 Degradation vs Parameter Errors 
(3 parameter model, 1 incorrect) 
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Another minor difference is that only the upper two 
elements of the diagonal were used when considering the 
trace of the covariance matrix of estimation error, since 
only two of the three plant states were estimated. The 
parameter becomes the value of the real part for the 
remote pole and the expected result is a monotonic 
increasing degradation as the pole location becomes 
less remote. Figure 4-3 shows a typical graph of this 
result. 

ad. MODEL ORDER REDUCED BY TWO 

A numerical example similar to c above was 

Simulated in which a fourth order type 0 system with two 
complex conjugate pole pairs was reduced to a second 
order filter type 0 model with the dominant pole pair 
identified exactly. The sensitivity parameters were 
taken as the damping factor z and natural frequency w 
associated with the remote complex pole pair. The pole 
locations for the plant were taken to be representative 
of the short period and phugoid oscillatory modes in 
the linearized model of an aircraft over a limited flight 
regime. The interpretation would be to find the degra- 
Gation in estimation of altitude and altitude rate which 
results from ignoring the short period vertical oscilla- 
tions of the airframe produced by elevator perturbations 
and air gusts. The results are shown in Figure 4-4. 
The numerical values used for the accurate model were 


iy See S ea = 35, Wo w= 20787 eee ae USS (4-4) 
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Fig. 4-4 Degradation vs Parameter Errors 
(4 parameter model, 2 incorrect) 
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while the erroneous model was taken as 
w= .073, 7 = .035 (4-5) 
The parameter ¢1 was allowed to vary from .175 to .525, 


with values of w,; from .575 to 1.725. 
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CHAPTER 5 

CONCLUSIONS 

The principal result of this investigation has been 
the derivation of an algorithm to replace the Kalman filter 
gain calculation when errors in the model of the dynamics 
of an observed system are known to exist. This algorithm 
can be used in two ways: either as a means for producing 
optimal estimates in a low order filter, or to determine 
the cost of parameter mis-identification in terms of 
estimation accuracy for some specific system. In the 
first application, the reduction in computation time 
associated with low order filtering is partially negated 
by the requirement for making two additional calculations 
at each iteration. Therefore such an application probably 
would become profitable only if the system model order can 
be reduced by two or more in the filter. It is felt 
that the use of equations 3-18, 3-15, 3-20 and 3-21 with 
various suboptimal gain sequences could assist in numer- 
ous design studies. An example would be the study of fil- 
ter performance degradation where a single filter model 
is to be used with many plants, each having slightly 
different parameters. Another example would be appli- 
cation of a Kalman filter scheme to a system with 
parameters which vary slowly with time. 

Development of the recursive expressions for cal- 
culating the actual covariance of estimation error, together 


with the computer simulation to test their utility, has 


a 


revealed some interesting sidelights. Perhaps the most 
Significant of these is the difficulty in obtaining a 
sensitivity function in the usual sense for other than the 
scalar cases. The second order, two-parameter case 

yields a set of four simultaneous non-linear matrix 
equations from which the partial derivatives must be 
produced. Thus, the sensitivity function approach was 
abandoned in favor of the recursive solution of actual 
degradation. 

Another interesting result was the fact that, in the 
particular numerical examples used in Chapter 4 the fil- 
ter performance degradation was not nearly as great as 
the authors had anticipated. The two-parameter degra- 
dation contours shown in Figure 4-2 describe a bowl- 
shaped surface in the "parameter error plane" as would 
be expected. However, the surface has a relatively flat 
bottom and allows considerable parameter error in certain 
directions without exceeding a one per cent degradation 
in performance. In view of the analytical results of the 
scalar examples in Chapter 3, the gradient of this surface 
near its minimum is considered to depend heavily on the 
values chosen for 2 and R. It is known that the ratio 
Q/R greatly affects variance reduction in most tracking 
filters. The higher this value, the greater will be 
the variance reduction. The numerical ratio used in all 


examples was 100 which is probably optimistic. A study 


a 


of the effect of this ratio on the gradien. of the 
surface of figure 4-2 might verify the foregoing 
remarks. 

From the examples of a low-order filter model, it 
appears that the idea of second order dominance for more 
complicated systems may have promise in certain digital 
filter applications. Although each specific application 
requires a Simulation such as those in Chapter 4, much 
of the guesswork associated with exactly what constitutes 
second order dominance can be eliminated, once the sim- 
ulation is performed. This subject might warrant further 
investigation to learn just how "remote" higher order 
system poles must be, how the values 2%, R, and 2/R 
affect estimation accuracy, etc. 

A related effect of erroneous filter models noted 
in this investigation was a Significant increase in the 
number of iterations required to achieve "steady state" 
in the calculated covariance as model errors increased. 
The filter "settling time" naturally depends heavily on 
initialization of x (070; and P(0/U), oul dependencesem 
errors in the plant model can further aggravate the 
Situation. Filter settling time or "“lock-on" can be 
very critical in certain applications such as fire control 
systems. This is another area which could be explored 
further. 

While the main objectives of this investigation 


have been realized, the Kalman filter is far from a dead 
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issue. On the contrary, completion of this work has 
served to open several new questions which can lead to 
successful application of the theoretical concepts 


embodied in optimal state estimation. 
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